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SAFE COLOR LIMITING OF A COLOR ON 
A DIGITAL NONLINEAR EDITING SYSTEM 

BACKGROUND 

5 Digital non-linear editing (DNLE) is a process by which digital media may be 

edited. DNLE, as the name implies, is performed on digital media stored as data in 
digital media files on a digital random access medium. DNLE may be conducted in a 
non-linear fashion because the digital media files in which the digital media is stored can 
be randomly accessed. Thus an editor may access a piece of the digital media without 

1 0 having to proceed sequentially through other pieces of the digital media stored in the 
same or other digital media files. More than one editor also may be able to access 
different pieces of the same digital media contemporaneously. The digital media may be 
a digitized version of a film or videotape or digital media produced through live capture 
onto a disk of a graphics or animation software application. Example commercial DNLE 

15 systems include the Media Composer® or the Avid® Symphony™ video production 
system or NewsCutter® news editing system available from Avid Technology, Inc. For 
a more detailed description of DNLE, see Digital Nonlinear Editing, New Approaches to 
Editing Film and Video , 1 993 , by Thomas Ohanian. 

Digital video is a form of digital media typically processed on a DNLE. Digital 

20 video is comprised of a sequence of digital images. Digital images are comprised of an 
array of picture cells called pixels. DNLE systems often process digital video at multiple 
rates. For example, the video may correspond to a playback rate of 30 (more precisely 
29.97) frames per second (fps) in accordance with the NTSC (National Television 
Standards Committee) standards, or 25 fps in accordance with PAL (phase alternate line) 

25 standards. The digital video may be captured from film which typically has a rate of 24 
frames per second. The United States of America and Japan have generally adopted the 
NTSC standards and European nations have generally adopted the PAL standards. There 
are multiple other formats for high definition and digital television signals. 

One frame defines a complete video image that can be displayed on a television 

30 screen. Frames include a series of odd and even lines of pixels. Frames are divided into 
two fields of information, where a first field includes all the odd lines of pixels, and a 
second field includes all the even lines of pixels. For example, for an NTSC frame 
typically including 525 lines, a first field includes pixels of lines 1, 3,5,.. 525, and the 
second field includes pixels of lines 2, 4, 6, . . ., 524. When the analog video signal is 
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broadcast to a television, the fields are alternatively scanned and drawn to the television 
screen. This alternate scanning is called interlacing. Formats using images that are not 
interlaced are called progressive. 

A variety of data formats can be used to represent the color of pixels within a 
5 digital image. Formats may be classified into two major categories: composite signals 
and component signals. Component formats represent a color as multiple components, 
each component defining a value along a dimension of the color space in which the color 
being represented is defined. A composite video is an analog signal that uses a high 
frequency subcarrier to encode color information with a signal that encodes luminance 

1 0 information. The subcarrier is a sinewave of which the amplitude is modulated by the 
saturation of the color represented by the signal, and the hue of the color is encoded as a 
phase difference from a color burst. Analog composite signals are generally used to 
broadcast television video signals. 

There are a variety of component formats used to represent color. RGB (Red, 

1 5 Green, Blue) format represents a color with a red component, a green component and a 
blue component. CMYK (Cyan, Magenta, Yellow, Black) format represents a color with 
a cyan component, a magenta component, and a yellow component. CMYK is a format 
commonly used by printers. The CMYK components are color opposites of RGB 
components. In a three-dimensional coordinate system, each component of either the 

20 RGB or the CMYK format represents a value along an axis, the combination of the 
values defining a cubic color space. 

The data formats HSL (Hue, Saturation, Lightness or Luminance) and HSV 
(Hue, Saturation, Value) represent a color with a hue component, a saturation 
component, and a luminance component. In a three-dimensional coordinate system, the 

25 luma component represents a value along a luma axis, the hue component represents the 
angle of a chroma vector with respect to the luminance axis and the saturation 
component represents the magnitude of the chroma vector. The combination of the 
values defines a hexagonal cone-shaped color space. 

YCrCb, YUV, and YIQ are three formats that represent a color with a luma 

30 component Y, and two chroma components, Cr and Cb, U and V, or I and Q, 

respectively, that define a chroma vector. In a three-dimensional coordinate system, 
each component of either the YCrCb, YUV, and YIQ format represents a value along an 
axis, the combination of the values defining a cylindrical color space around the luma 
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axis. The chroma components define the chroma vector. In data formats with a 
luminance component, the luma component can be used independently to represent a 
pixel in a black and white image to be displayed, for example, with a black and white 
monitor. 

5 YCrCb is a format used for digital video signals; YUV and YIQ are formats used 

for analog video signals. A standard YcrCb format is the 4:2:2 Y6oiCrCb format (CCIR 
601 format), where the luma component, Y6oi ? of the pixels of the component signal are 
transmitted at twice the frequency of the chroma components, Cr and Cb (hence the 
notation 4:2:2). Only every other pixel (even pixel) is represented with chroma 

10 components. For example, the components of the pixels, P0, PI, P2, P3, etc., of a 601 
format signal are transmitted as follows: Cr0,Y0,Cb0, Yl, Cr2, Y2, Cb2, Y3, etc. When 
the video image is displayed, the chroma components of the odd pixels are determined 
by averaging, combining, interpolating, etc., the chroma components of the preceding 
even pixel and the next even pixel. The 4:2:2 sampling rate is used to save bandwidth on 

15 the broadcast medium, and also saves storage space when storing the signal. 

The analog component YUV format is the format from which an analog 
composite signal may be constructed. The relationship between the YUV components 
and the values of the NTSC analog composite sine wave are as follows: Amplitude = 
[0.0925 • (Y+C) + 0.075], 

20 where C = V • sin (cot + 0.576) + U • cos(cot + 0.576), and oo = 3.579545 MHz. 

When components of a component signal are combined into a composite signal, 
it is possible for some component combinations to push the signal amplitude above or 
below some threshold value. When the frequency band of the signal is too wide, the 
color is considered "unsafe", because it may cause interference with a television signal 

25 having a different carrier frequency. The component signal is corrected such that the 
resulting composite signal is within a "safe region." Various methods have been 
developed to correct a component signal such that a composite signal constructed from 
the component signal is within a safe region. 

SUMMARY 

30 One problem with current techniques for safe color correction of a pixel is that 

the resulting corrected color may not be the closest color in the three-dimensional color 
space to the original unsafe color. This problem may occur if the three components of 
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the signal are not reduced proportionately. Typically less than all three components are 
corrected or clipped. In particular, the luminance component often is not changed. 

When a corrected pixel is displayed along with proximate pixels that were not 
corrected, or other pixels which were corrected, artifacts may be seen in a portion of an 
5 image. These artifacts may be reduced by modifying the luminance component. By 
modifying an unsafe color such that both the luma component and the chroma 
components are modified, the unsafe color is mapped to the closest safe color in the 
color space and such artifacts are further reduced. 

Also, unsymmetrical relationships between the components of a component color 

10 may involve complex operations to be perfomed on the components to determine if the 
color is safe, and to determine the modifications to be applied to an unsafe color to make 
it a safe color. Safe color modification provides a method of transforming a component 
color into a safe color space. A component color of a first color space is received. The 
component color is transformed into a safe color space by applying conversion terms to 

15 each component of the component color. The transformation into a safe color space 
creates symmetrical relationships between the color components, which permits 
simplified operations to be performed on the components. 

In one aspect, a method is provided of generating components for a pixel to 
provide safe color from components of the pixel according to a threshold defining safe 

20 color. The components include a luma component, a first chroma component, and a 

second chroma component. It is determined whether a combination of a first luma value 
associated with the luma component and a first chroma value associated with the first 
and second chroma components of the pixel exceeds the threshold defining safe color. If 
the combination exceeds the threshold defining safe color, the luma component of the 

25 pixel is modified to generate safe components. 

In an embodiment, if the combination exceeds the threshold defining safe color, 
the first and second chroma components of the pixel are modified to generate 
components within the threshold defining safe color. 

In another aspect, provided is a method of generating correction values for 

30 modifying components of a pixel to provide a safe color according to a threshold 
defining safe color. The color components are transformed into safe space. It is 
determined whether a combination of the transformed color components exceeds the 
threshold defining safe color. If the combination exceeds the threshold defining safe 
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color, component correction values are generated to be applied to the components and 
produce safe components. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings, 

5 Fig. 1 is a data flow diagram illustrating an embodiment of a system for safe 

color modification; 

Fig. 2 is a data flow diagram illustrating an embodiment of the system of Fig. 1 
in more detail; 

Fig. 3 is a data flow diagram illustrating an embodiment of the operation of a 
1 0 luma threshold converter; 

Fig. 4 is a flow chart illustrating an embodiment of a process performed by a 
luma clipper; 

Fig. 5 is a flow chart illustrating an embodiment of a process performed by the 
system of Fig. 1 ; 

15 Fig. 6 is a data flow diagram illustrating an embodiment of the operation of the 

safe color limiter of Fig. 2; 

Fig. 7 is a flow chart illustrating an embodiment of a process performed by the 
conversion term generator of Fig. 6; 

Fig. 8 is a flow chart illustrating an embodiment of a process performed by the 
20 luma converter of Fig. 6; 

Fig. 9 is a flow chart illustrating an embodiment of a process performed by the 
chroma converter of Fig. 6; 

Fig. 10 is a flow chart illustrating an embodiment of a process performed by the 
chroma clipper of Fig. 6; 
25 Fig. 1 1 is a flow chart illustrating an embodiment of a process performed by the 

safe color limiter of Fig. 6; 

Fig. 12 is a flow chart illustrating an embodiment of a process performed by the 
correction generator of Fig. 6; 

Fig. 13 is a flow chart illustrating an embodiment of a process performed by the 
30 safe color generator of Fig. 6; 

Fig. 14 is a block diagram illustrating a known format for a color component 

signal; 
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Fig. 1 5 is a data flow diagram illustrating an embodiment of a safe odd luma 
generator; 

Fig. 16 is a flow chart illustrating an embodiment of a process performed by the 
safe odd luma generator of Fig. 15; 
5 Fig. 17A is an illustration of the double cone space color space of a Y6oi Cb C r 

component color; 

Fig. 17B is a cross-sectional view of the double cone of Fig. 17A; 

Fig. 1 8 A is a diagram illustrating the double cone representing safe colors of a 
YUVire , component color; 
10 Fig. 18B is a cross-sectional view of the double cone of Fig. 18A; 

Fig. 19 is an illustration of a double triangle representing the double cone of Fig. 
1 8 A collapsed into two-dimensional space; 

Fig. 20 is the double triangle of Fig. 19 in safe space; 

Fig. 21 is a diagram illustrating how space color modification is applied to unsafe 
15 pixels; and 

Fig. 22 is a diagram illustrating how the safe color modification applied in Fig. 
21 affect the two chroma components of the component color. 

DETAILED DESCRIPTION 
20 The following detailed description should be read in conjunction with the 

attached drawing in which similar reference numbers indicate similar structures. All 
references cited herein are hereby expressly incorporated by reference. 

Safe color modification modifies a luma component and chroma components of a 
color to produce the closest safe color of a three-dimensional color space. Safe color 
25 modification simplifies the process of modifying the color components by transforming 
each component of a pixel into a coordinate system, referred to herein as safe color space 
or safe space. After the pixel values are transformed into safe space, safe color 
modification checks whether a combination of the transformed values is unsafe. If the 
combination is unsafe, the correction values that are applied to the original color 
30 components are determined, and then applied to the original color components. The 
transformation into safe space allows simpler mathematical operations to be performed 
in determining the correction values and applying these values to the components. The 
simpler operations allow the color corrections to be applied to the luma and chroma 
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components at a faster rate, thus increasing the rate at which safe color modification of a 
color can be performed. 

The safe color transformation creates symmetrical relationships between the 
components of a component color that simplify the mathematical operations and provide 
5 a few common formulas capable of being applied to determine all correction values, 

regardless of the value of unsafe color to be corrected. The symmetrical relationships are 
realized by incorporating three general steps into the transformation: a) converting the 
elliptical cross-section of a three-dimensional safe color double-cone of a three- 
dimensional space into a circular cross-section, b) collapsing the three-dimensional 

10 double-cone into a two-dimensional double-triangle in two-dimensional color space, and 
c) centering a luma axis defined by the double-triangle about the luma origin such that 
the double triangle is collapsed into a triangle defined by only positive values. Described 
below is a system and method of safe color modification including a transformation into 
safe space that incorporates the three general steps. Following the description of system 

15 and method is a detailed description of the principles from which the system and method 
are derived. 

FIG. 1 is a data flow diagram illustrating an embodiment of a safe color 
modification system 1 . A color limiter 4 has an input for receiving a component signal 2 
and an input for receiving color limiting parameters 8. Applying the color limiting 

20 parameters 8 to the component signal 2, the color limiter 4 generates a safe component 
signal 6 through its output. 

FIG. 2 is a data flow diagram showing an embodiment of the safe color 
modification system 1 of FIG. 1 in more detail. The component signal 2 includes a first 
chroma component 10, a second chroma component 12, and a luma component 14. The 

25 color limiter 4 includes a luma clipper 16 and a safe color limiter 24. The safe 

component signal 6 includes a safe first chroma component 26, a safe second chroma 
component 28, and safe luma component 30. The color limiting parameters 8 include 
luma threshold values 20 and safe color parameters 22. 

The luma clipper 16 receives through its inputs a luma component 14 and luma 

30 threshold values 20. The luma clipper 16 then generates a checked luma component 1 8 
that is sent through its output to the safe color limiter 24 in a manner described in more 
detail below in connection with Fig. 4. The safe color limiter 24 receives through its 
inputs components 92 and the safe color parameters 22. The components 92 include the 
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first chroma component 10, the second chroma component 12, and the checked luma 
component 18. The safe color limiter 24 generates the safe first chroma component 26, 
the safe second chroma component 28, and the safe luma component 30, in a manner to 
be described below in connection with Fig. 5. 
5 In an embodiment of safe color modification, the luma threshold values are 

converted from IRE units as defined by NTSC into Y' 6 oiC r C b (601 units). This 
embodiment may be used, for example, if the luma threshold values are received from a 
user interface (not shown) that operates with IRE units, and the received component 
signal 2 is in 601 units. An example of such a user interface is described in U.S. Patent 

10 Application "Source Color Modification on a Digital Nonlinear Editing System" by 
Robert Gonsalvez, filed on even date herewith, and in "Apparatus and Method for 
Generating and Displaying Histograms of Color Images for Color Correction," by Robert 
Gonsalvez, filed on even date herewith. 

FIG. 3 is a data flow diagram illustrating an embodiment of luma threshold 

1 5 conversion. A luma threshold converter 36 receives through its inputs a luma high 

threshold value 32 in IRE units, a luma low threshold value 34 in IRE units, and a black 
level setup value 45. The black level setup value is a value representing an offset that is 
applied to a luma value in IRE units before converting to a luma component Y of a 
component signal in 601 units. The luma threshold converter 45 applies the black level 

20 setup value 45 to the IRE threshold values 32 and 34 to generate a luma high threshold 
value 40 in 601 units and a luma low threshold value 38 in 601 units at its output. The 
luma high and luma low threshold values 40 and 38, respectively, which are the luma 
threshold values 20 of FIG. 2, may be generated by the execution of the following 
equations. 

zr i v r-i* tt- i 219 •(Y Clip High mF - setup) 
25 Equation la : Y_Chp _ High mx = — ~ ~ — — — — + 1 6, 

(1 00 - setup) 

zr v r*v i 219*(Y _Clip Low mr - setup) 

Equation la : YjChp _ Low m = = — — — + 16, 

(100 -setup) 

where Y_Clip_High 6 oi is the luma high threshold value 40 in 601 units, Y_Clip_Highi RE 
30 is the luma high threshold value 32 in IRE units, setup is the black level setup value 45, 
Y_Clip_Low 6 oi is the luma low threshold value 38 in 601 units, and Y_Clip_Lowi RE is 
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the luma low threshold value 34 in IRE units. The derivation of Equations la and lb is 
described in detail below. 

FIG. 4 is a flow chart illustrating the operation of the luma clipper (16 in Fig. 2, 
42 in Fig. 3). In step 1 10, a luma high threshold value 40 is compared to the value of the 
5 luma component 14. If it is determined that the value of the luma component 14 is 
greater than the luma high threshold value 40, then the value of the luma component is 
clipped to the luma high threshold value 40, i.e., the checked luma component 18 is set 
equal to the luma high threshold value 40 in step 1 12. In an embodiment, an interrupt or 
event may be generated in step 1 13 to indicate that a luma value is too high. This 

10 interrupt or event may be used to interrupt the safe color modification process in order to 
inform a user that a luma component with a value outside of the range defined by the 
threshold values has been received. In one embodiment, the interrupt or event may be 
addressed after all the pixels of a display field have been processed by the color limiter 4. 
In an alternative embodiment, no interrupt or event is generated in step 113, and the luma 

15 clipper 16 automatically clips the luma component 14. 

If the value of the luma component 14 is not greater than the luma high threshold 
value, then in step 1 14 the luma component is not clipped, i.e., the checked luma 
component 18 remains equal to the value of the luma component 14. In step 116, the 
checked luma component 1 8 is then compared to the luma low threshold value 38. If the 

20 checked luma component 1 8 is less than the luma threshold value 38, then the luma 
component 14 is clipped to the luma low threshold value, i.e., the checked luma 
component 18 is set equal to the low threshold value in step 118. In step 1 19, an 
interrupt or event may be generated, similar to step 113. If in step 1 16 it is determined 
that the checked luma component 1 8 is not less than the luma threshold value, then the 

25 luma component is not clipped, i.e., in step 120 the checked luma component remains 
equal to the luma component 14. Comparisons of the luma component to the high and 
low thresholds may be performed in any order or in parallel. 

FIG. 5 is a flow chart illustrating the operation of the safe color limiter 24 of 
FIG. 2. In step 122, conversion terms are generated from the safe color parameters 22. 

30 In step 124, the conversion terms are applied to the safe color limiter inputs 92 to 
generate converted color components, which include a converted luma component, a 
converted first luma component, and a converted second chroma component. In step 
128, it is determined whether a combination of the converted luma and chroma 
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components exceeds a threshold value. If the combination of components does not 
exceed the predetermined threshold value in step 128, the components are output as the 
safe color components in step 130. Otherwise, if the combination does exceed a 
threshold value in step 128, then in step 132 color correction terms are generated. In step 
5 134, the color correction terms are applied to the safe color limiter inputs. After the 
color correction terms are applied to the color component signal in step 1 34, the safe 
color components of the components 6 (Fig. 1) then may be combined to form a safe 
composite signal that can be used for broadcast or transmission. 

FIG. 6 is a data flow diagram illustrating the operation of the safe color limiter 

10 24 of FIG. 2 in more detail. The safe color limiter 24 includes a conversion term 

generator 44, a color converter 58, a safe color checker 74, a correction generator 80, and 
a safe color generator 90. The color converter 58 includes a luma converter 60, a chroma 
clipper 62, and a chroma converter 64. The safe color parameters 22 include a color high 
threshold value 49, a color low threshold value 47, and the black level setup value 45. 

1 5 The color threshold values 49 and 47 define a high and low threshold value, respectively, 
for a combination of the checked luma component 18, the first chroma component 10, 
and the second chroma component 12. 

The conversion term generator 44 receives the color high threshold value 49, the 
color low threshold value 47, and the black level setup value 45. The conversion term 

20 generator 44 generates conversion terms 46, which include a luma scale value 48, a luma 
offset value 50, a first chroma scale value 52, a second chroma scale value 54, and an 
inverse luma scale value 56. The inverse luma scale value 56 is an inverse of the luma 
scale value 48. 

The color converter 58 receives the conversion terms 46 and safe color limiter 
25 inputs 92, which include the checked luma component 1 8, the first chroma component 
10, and the second chroma component 12. The color converter applies the conversion 
terms 46 to the color limiter inputs 92 to generate converted color values 66. The 
converted color values 66 include a converted luma value 68 and a converted chroma 
value 70. The luma converter 60 receives the luma scale value 48, the luma offset value 
30 50, and the checked luma component 18 as inputs and generates the converted luma 

value 68 at an output. The chroma converter 64 receives the first chroma scale value 52, 
the second chroma scale value 54, the first chroma component 10, and the second 
chroma component 12 as inputs and generates a combined chroma value 72 at its output. 
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The chroma clipper 62 receives the combined chroma value 72 and the converted luma 
value 68 and generates the converted chroma value 70. 

The safe color checker 74 receives the converted color values 66, generates 
correction flags 76, and may generate an interrupt 75. In some embodiments, an event 
5 may be generated. In an embodiment, the correction flags 76 are stored in an odd luma 
register 78, which is described in more detail below. 

The correction generator 80 receives correction flags 76, the inverse luma scale 
value 56, the combined chroma values 72 and the converted color values 66. The 
correction generator 80 generates color correction values 82, which include a luma 
10 correction value 88 and a chroma correction value 84, to be applied to the safe color 
limiter inputs 92. 

The safe color generator 90 receives the safe color limiter inputs 92 and the color 
correction values 82, and generates the safe component signal 6, which includes the safe 
luma component 26, the safe first chroma component 28, and the safe second chroma 

15 component 30. If no modification is to be made to inputs 92, the inputs 92 simply pass 
through the generator 90 as the output components 6. 

FIG. 7 is a flow chart illustrating an embodiment of the operation of the 
conversion term generator 44. In steps 132-136, the color high threshold value 49, the 
color low threshold value 47, and the black level setup value 45, respectively, are 

20 received. These steps and other steps in this flowchart may be performed in any order or 
in parallel. In step 138, a luma scale factor 48 is generated. In an example embodiment 
where the component signal is a 601 signal, the luma scale factor 48 is generated by the 
execution of the following equation: 

256 •(100- setup) 



25 



Equation 2 : YJScale = 



219 • (Color High - Color Low) 



where setup is the black level setup value 45 , Color High is the color high threshold 
value 49, and Color Low is the color low threshold value 47. The derivation of 
Equation 2 is described in detail below. 

In step 140, the luma offset 50 is generated. In the example embodiment where 
30 the color component signal is a 601 signal, the luma offset 50 is generated by execution 
of the following equation: 
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E uation3 ■ Y Offset - 256 * ( 235 - setu P -1600-109.5* (Color High + Color _Low) 
qua ion . _ Jjse 219 •(Color High -Color Low) 



where setup is the black level setup value 45, Color_High is the color high threshold 
5 value 49, and Color_Low is the color low threshold value 47. The derivation of 
Equation 3 is described in detail below. 

In step 142, the first chroma scale value 54 is generated. In the example 
embodiment where the color component signal is a 601 signal, the first chroma scale 
value is generated by the following equation: 

. A _ , 16 • 0.436010346 • (100 -setup) 

1 0 Equation 4 : Cn Scale = ■ — , 

7 • (Color High - Color Low) 

where setup is the black level setup value 45, ColorHigh is the color high threshold 

value 49, and ColorLow is the color low threshold value 47. The derivation of 

Equation 4 is described in detail below. 

15 In step 144, the second chroma scale value 54 is generated. In the example 

embodiment where the color component signal is a 601 signal, the second chroma scale 

value is defined by the equation: 

. c 0 f 16 • 0.614975383 • (100 -setup) 

Equation 5 : Cr Scale = — , 

7 • (Color JHigh - Color Low) 

20 where setup is the black level setup value 45, Color_High is the color high threshold 
value 49, and Color Low is the color low threshold value 47. The derivation of 
Equation 5 is described in detail below. 

In step 146, an inverse luma scale factor is generated. In the example 
embodiment where the color component signal is a 601 signal, the inverse luma scale 
25 factor is simply the inverse of Equation 2 above: 

1 _ 219 • (Color High - Color Low) 



Equation 6 : 



YJScale 256 •(100- setup) 



FIG. 8 is a flow chart illustrating an embodiment a process performed by the 
luma converter 60. In steps 148 through 150, the luma scale value 48, the luma offset 
30 value 50, and the checked luma component 18 are received. The order of steps 148 
through 150 may be performed in any order or in parallel. 
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In step 1 52, the converted luma value 68 is generated. In the example 
embodiment where the color component signal is a 601 signal, the converted luma value 
may be defined by the following equation: 

5 Equation 7 : Yss = Ych • Y Scale + Y Offset, 

where Yss is the converted luma value 68 and Ych is the checked luma component 18, 
Y_Scale is the luma scale value 48, and Y_Offset is the luma offset value 50. The 
derivation of Equation 7 is described in detail below. 

10 Fig. 9 is a flow chart illustrating an embodiment of a process performed by the 

chroma converter 64. In steps 153 and 155, the first and second chroma scale values 52 
and 54, and the first and second chroma components 10 and 12 are received. 

In step 157, a converted first chroma component is generated. In the example 
embodiment where the color component signal is a 601 signal, the converted first 

15 chroma component may be defined by the following equation: 

Equation 8: Uss = (C B - 128) • Cb Scale , 

where Uss is the converted first chroma component, C B is the first chroma component 
10, and C B _scale is the first chroma scale value 52. The derivation of Equation 8 is 
described in detail below. 
20 In step 159, a converted second chroma component is also generated. In the 

example embodiment, if a color component signal is a 601 signal, the converted second 
chroma component is defined by equation 9 as follows: 



25 



Equation 9 : V S s = (Cr- 128) • Cr Scale , 



where V S s is the converted second chroma component, C r is the second chroma 
component 12, and C r _JScale is the second chroma scale value 54. The derivation of 
equation 9 is described in detail below. 

In step 156, the combined chroma value 72 is generated by combining the 
30 converted first and second chroma components. In the example embodiment where the 
color component signals a 601 signal, the combined chroma value 72 is defined by 
equation 10 as follows: 
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Equation 10: Css = VUss + Vss • 

where C S s is the combined chroma value 72, U S s is the converted first chroma 
component, and Vss is the converted second component. The derivation of equation 10 
5 is described in detail below. 

Thus, equations 7-10 implement the transformation into a safe color space that 
permit simpler operations to be performed on color components. Such operations may 
include checking whether the color is safe and if the color is not safe, and determining 
the corrections to be applied to the components, as described in detail below. 

10 Fig. 10 is a flow chart illustrating an embodiment of a process performed by the 

chroma clipper 62. In steps 160 and 161, the converted luma value 68 and a combined 
chroma value 72 are received. The steps 160 and 161 may be performed in any order or 
in parallel. In step 162, the converted luma value 68 is combined with a predetermined 
threshold value to produce a chroma threshold value. In the example embodiment, 

15 where the color component signal is a 601 signal, the chroma threshold value is defined 
by equation 1 1 as follows: 

Equationll: | Yssl + 128, 

20 where Y S s is the converted luma value 68. The derivation of equation 1 1 is described in 
detail below. 

In step 163, the combined chroma value 72 is compared to the chroma threshold 
value. If it is determined in step 163 that the combined chroma value 72 is greater than 
the chroma threshold value, then at step 165, the combined chroma value 72 is clipped to 
25 the chroma threshold value to produce the converted chroma value 70. If it is determined 
in step 163 that the combined chroma value 70 is not greater than the chroma threshold 
value, then in step 164 the converted chroma value 70 is set equal to the combined 
chroma value. 

FIG. 1 1 is a flow chart illustrating an embodiment of a process performed by the 
30 safe color checker 74 of Fig. 6. In step 166, the converted luma value 68 and the 

converted chroma value 70 are received. In step 168, the magnitude of the converted 
luma value 68 and the converted chroma value 70 are combined to generate a combined 
value. In step 170, the combined value is compared to a predetermined threshold value. 
If it is determined in step 1 72 that the combined value is not greater than the 
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predetermined threshold value, then a correction flag is cleared in step 174. In an 
alternative embodiment, the correction flag is initialized between steps 1 70 and 1 72, and 
in the event that the combined value is not greater than the predetermined threshold 
value, the correction flag remains cleared. 
5 If in step 1 72 it is determined that the combined value is greater than the 

predetermined threshold value, then in step 176 it is determined whether the converted 
luma value 68 is a positive or negative value. If it is determined that the converted luma 
value 68 is a positive value, then in step 1 77 a "color too high" correction flag is set and 
in step 178 a "color too high" interrupt is generated. In an alternative embodiment, a 

10 "color too high" event is generated in step 178. If the converted luma value is a negative 
value, then in step 179 a "color too low" correction flag is set and in step 1 80 a "color 
too low" interrupt is generated. In an alternative embodiment, a "color too low" event is 
generated on step 180. 

The correction flags are used in order to determine the color correction values to 

15 be generated by the color correction generator 80. The interrupts, or alternatively the 
events, are used to inform the system that an unsafe color has been detected. In an 
embodiment, after the entire field of which the current pixel belongs has been processed, 
the color too high and color too low interrupt or events either may be ignored or may be 
used to generate a warning for a system user. In an alternative embodiment, interrupts or 

20 events are generated after each pixel or each line of a video field has been processed. In 
yet another alternative embodiment, no interrupt or event is generated, and the safe color 
modification is automatically executed. 

FIG. 12 is a flow chart illustrating an embodiment of a process performed by the 
correction generator 80. In steps 182-188, the combined chroma value 72, the converted 

25 luma value 68, the converted chroma value 70, the color correction flags 76, and the 
inverse luma scale value 56 are received. The steps 182-188 may be performed in any 
order or in parallel. In step 190, the color correction generator 80 determines whether 
either of the correction flags 76, the "color too high" flag or the "color too low" flag, are 
set. If neither of the correction flags 76 are set, a luma correction offset 88 is set to zero 

30 in step 192 and a chroma correction scalar 84 is set to one in step 194. The values for the 
luma correction offset 88 and the chroma correction scalar are called "passthrough" 
values because these "passthrough" values allow the original luma and chroma 
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components, 18, 10, and 12, respectively, to pass through the safe color generator 90 
unmodified. 

If either of the correction flags are set, a luma correction offset is generated in 
step 196. In the example embodiment where the color component signal is a 601 signal, 
5 the luma correction offset is defined by the following equation: 

Equation 12: Ye = 1 Yss 1 " 128 + CcH • Inverse __Y_Scale , 

2 

where Y c is the luma correction offset 88, Y S s is the converted luma value 68, C C h is the 
10 converted chroma value 70, and inverse_Y_scale is the inverse luma scale value 56. If 
the color too high correction flag is set, then the luma correction offset 88 will have a 
positive value. If the color too low correction flag was not set or cleared, then the luma 
correction offset 88 has a negative value. The derivation of Equation 12 is described in 
more detail below. 

15 In step 198, the chroma correction scalar 84 is generated. In the example 

embodiment where the color component signal is a 601 signal, the chroma correction 
scaler 84 is defined by the following equation: 

Equation 13 : Cc = 128 ^ Y ^ C ™ y 

2*Css 

20 where C c is the chroma correction scalar 84, Y S s is the converted luma value 68, C C h is 

the converted chroma value 70, and Css is the combined chroma value 72. 

FIG. 13 is a flow chart illustrating an embodiment of a process performed by the 

safe color generator 90 of Fig. 6. In steps 202 and 204, the safe color generator 90 

receives the luma correction offset 88 and the chroma correction scaler 84. The steps 
25 202 and 204 may be performed in any order or in parallel. In step 208, the luma 

correction offset 88 is added to the checked luma component 18 to generate the safe 

luma component 26. 

In steps 209-21 1, the first chroma component 10 is offset by a chroma offset 

value, multiplied by the first chroma correction scalar 84, and offset again by an opposite 
30 value of the chroma offset value to generate the first safe chroma component 28. In the 

example embodiment where the component color signal is a 601 signal, the safe first 

chroma component 28 is defined by the following equation: 
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Equation 14 : C B corr = [(C B -128)m Cc J + 128 , 

where C corr is the safe first chroma component, C B is the first chroma component 10, C c 
is the chroma correction scalar value 84, and 128 is the chroma offset value. 
5 In steps 212, 213, and 215, the second chroma component is offset by the chroma 

offset value, multiplied by the chroma correction scalar 84, and then offset by the 
opposite value of the chroma offset value to generate the second safe chroma component 
30. In the example embodiment where the color component signal is a 601 signal, the 
safe second chroma component 30 is defined by following equation: 

10 

Equation 15 : C Rc( ,rr = [(Cr- J 28 ) • Cc J + 128, 

where C Rc orr is the second safe chroma component 30, C R is the second chroma 
component 12, C c is the chroma correction value 84, and 128 is the chroma offset value. 

15 In one embodiment, the color limiting parameters 8 are constrained. In 

particular, the luma high threshold value 40 is less than or equal to the color high 
threshold value 49, and the luma low threshold value 38 is greater than or equal to the 
color low threshold value 47. The black level setup value 45 also ranges from 0 to 7.5 
IRE. The color low threshold value also ranges from -40-10 IRE, and the color high 

20 threshold value ranges from 90-1 33 IRE. 

In the example embodiment, if the color component signal is a 601 signal, the 
luma high threshold value is 255 and the luma low threshold value is 0, because the luma 
component for a 601 is within that range. Using the luma high threshold and luma low 
threshold values 40 and 38 in combination with the assumed values above, for a 601 

25 signal, the conversion terms are defined as follows: the luma scale offset 48 ranges from 
0.625-1.461; the luma offset value 50 ranges from -183.379-47.770; the first chroma 
scale value 52 ranges from 0.5329-1.2457; the second chroma scale value 54 ranges from 
0.7516-1.7571; and the inverse luma scale value 56 ranges from 0.684-1.600. 

Some component color formats, such as the 601 format do not include chroma 

30 components to represent every pixel of a digital image, because a 601 signal samples the 
luma component at twice the frequency that it samples the chroma components. Thus, 
some pixels are represented by a luma component and chroma components, and other 
pixels are represented by only a luma component. 
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FIG. 14 is a data flow diagram illustrating a 4:2:2 Y 6 oi C B C R component signal. 
Cbo, Yo and CRo represent an even pixel 214, having a luma component Y 0 and two 
chroma components Co and CR 0 . Yj represents an odd pixel 216 represented only by a 
luma component, and pixel 218 represents another even pixel. In one embodiment of 
5 safe color modification, the chroma components of even pixels 214 and 218 are 

interpolated to generate the chroma components of the odd pixel 216, and then safe color 
modification is applied to those values. Since this embodiment may use significant 
processing resources, an alternative embodiment of safe color modification for odd luma 
components that requires fewer resources is illustrated in Fig. 15 and Fig. 16. 

10 FIG. 15 is a data flow diagram illustrating safe color modification of an odd luma 

component. The luma clipper 1 6 receives an odd luma component 1 6 and generates a 
checked odd luma component 228. This operation is analogous to how a checked luma 
component 18 is generated from a luma component 14, as described above with respect 
to Figs. 2-4. The safe odd luma generator 230 receives the checked odd luma 

15 component 228, a preceding safe luma component 220, a preceding color correction flags 
222, a next safe luma component 224, and a next color correction flags 226, and 
generates a safe odd luma component 232. 

Referring to FIG. 14, for the odd luma component 216, the preceding safe luma 
component would be the safe luma component resulting from applying safe color 

20 modification to the preceding as described in FIGS. 1, 2 and 5. The preceding color 
correction flags are the resulting flag 76 of Fig. 5 resulting from applying safe color 
modification to the even pixel 214. The next safe luma component 224 is the safe luma 
component 26 in Fig. 5 resulting from applying safe color modification to the even pixel 
218. The next color correction flags 226 are the color correction flags 76 in FIG. 6 

25 resulting from applying safe color modification to the even pixel 218. 

FIG. 16 is a flow chart illustrating safe color limiting of an odd luma component. 
In step 234, the luma clipper 16 receives the odd luma component 216, and in step 236, 
the odd luma component may be clipped in accordance with the process described in 
FIG. 4. In step 238, the preceding color correction flags are accessed from the odd luma 

30 register of FIG. 6. In step 240, it is determined whether the odd luma component is the 
last luma component of the display field. If the odd luma component is the last 
component of the display field, then the safe odd luma component 232 will be derived 
only from a previous even pixel. For example, in FIG. 14, if odd luma component 216 is 
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the last luma component of the display field, then the odd luma component 216 would 
only be concerned with the even pixel 214. 

If the odd luma component is not the last component of the display field, the safe 
odd luma generated 230 accesses the next color correction flags 226 from the odd luma 
5 register 78. Next, the safe odd luma generator 230 determines whether either of the next 
color correction flags are set. If either of the next color correction flags are set, then in 
step 248 the preceding safe luma component is accessed, and in step 250 the next safe 
luma component is accessed. Next, in step 252, the safe odd luma component is set 
equal to the average of the preceding safe luma component and the next safe luma 
10 component. 

If in step 244 it is determined that neither of the next color correction flags are 
set, then in step 246 it is determined whether either of the preceding color correction 
flags are set. If either of the preceding color correction flags are set, then in step 248 the 
preceding safe luma component is accessed, and in step 250 the next safe luma 

15 component is accessed. Finally, in step 252, the safe odd luma component 232 is set 
equal to the average of the preceding safe luma component in the next safe luma 
component. The steps of 244 may be performed in any order or in parallel. 
0 If in step 246 it is determined that neither of the preceding color correction flags 
is set, then in step 256, the safe odd luma component 232 is set equal to the odd luma 

20 component 216. 

If in step 240 it is determined that the odd luma component is the last luma 
component of the display field, then in step 254 it is determined whether either of the 
preceding color correction flags are set. If either of the preceding color correction flags 
are set, then in step 258, the preceding safe luma component is accessed, and in step 260, 

25 the safe odd luma component 232 is set equal to the preceding safe luma component. 

If in step 254 it is determined that neither of the preceding color correction flags 
are set, then in step 256, safe odd luma component 232 is set equal to the odd luma 
component 216. 

In one embodiment, the preceding color correction flags and the next color 
30 correction flags also may be the result of an OR operation on the preceding color 
correction flags and the next color correction flags, respectively. 

Thus equations 7-10 transform the color components into safe space, where it is 
determined whether the color is safe. If it determined that the color is unsafe, equations 
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12 and 13 may be applied to determine the corrections to be applied to the color 
components to generate a safe color. The corrections then may be applied the color 
components. 

Having described the system and method of safe color modification, the 
5 principles from which the system and method are derived will now be discussed. 

Generally checking for a safe color of a pixel includes determining that the luma 
is within range of values, and determining that the sum of the luma and the chroma is 
within range of values. This checking may be summarized by the following equations: 
Y < lumajiigh; Y > luma_low; Y + C < color value _high; and Y - C > color_low, 

10 where the variable C is defined by C = Vu 2 + V 2 , Y is the luma and U and V are chroma 
components, color high is a color high threshold value, colorlow is a color low 
threshold value, lumajiigh is a luma high threshold value, and luma_low is a luma low 
threshold value. Luma_high is less than or equal to chroma_high, and luma_low is 
greater than or equal to chroma_low, as discussed in more detail below. 

15 Throughout the description that follows, safe color modification is described with 

respect to a 4:2:2 Y 6 oiCbC r video format (601 format). The principles of safe color 
modification may be applied to other video formats as well. 

In order to test for the color limits, the 601 components are converted to YUV 
space. This format is commonly used to convert video components of a component 

20 signal into a composite signal. 

However, the luma_high and luma_low values, and the color_high and color low 
values may be expressed in IRE units. Thus, after converting into YUV format, the 
components are converted to IRE units. To simplify the analysis, and the calculation of 
modifications to be applied to components, the YUVire components are then 

25 transformed into a "safe space" coordinate system. The mathematical operations for 
converting from 601 format to YUV format to YUVi RE format to safe space are 
described below. These operations are then combined for transforming from 601 format 
directly to safe space. The resulting transformations are embodied in three equations, 
each equation specific to a color component. Each equation is applied to its 

30 corresponding component to convert the component from 601 format directly to safe 
space. 



10 
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After determining the transformations from 601 format to safe space, 
modifications determined in safe space can be converted from safe space to 601 format 
by applying inverse transformations to the modifications. These modifications can then 
be applied to the original color components in 601 format. 

The following description considers the even pixels of a 4:2:2 signal. As 
discussed above, the odd luma components of a 4:2:2 signal are handled differently and 
in the manner shown in Figs. 14-16. To convert from YC B C R to IRE, it is easier to first 
convert to YUV space where Y has a range from 0 to 1 , and Y 6 oi has a range of 16 - 235, 
leading to the conversion equation: 

Equation 16 : Y • (Y 60l - 1 6) 

where, Y 6 oi represents the luma component or Y component in the 601 format, and Y is 
the luma component of the YUV format. 

15 The C B and the C R components have a range from 16 - 240 with an offset of 128. 

After the offset is removed, they cover a range of plus or minus 112. The U chroma 
component has a range of ± 0.436010346 and the V chroma component has a range of ± 
0.614975383. These ranges may be derived from the definitions of the YUV and YC B C R 
formats described herein. For a more detailed description of the color video and color 

20 science describing the derivation of these conversion values, see Charles Poynton's 
Color FAQ: http://www.inforamp.net/-poynton. Thus, the following equations 17 and 
1 8, for converting the chroma components in 601 format to 
YUV format are derived: 

■ in rr 0.4360 J 0346 , 

Equation 17 : U = — • (Q n ~ 128) 

25 

- to t, 0.614975383 , 

Equation 18 : V — — • (C R - 128) 

Converting to YUV space creates the correct ratios between Y, U and V for 
30 encoding to a composite signal. To actually convert to an IRE scale for a real composite 
signal, the black level set up as defined for NTSC also is used. Thus, for converting 
from YUV to YUVire the following equations 19 , 20 and 21 are used: 
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Equation 19 : Yjre=Y • (100 - setup) + setup 

Equation 20 : Uire= U •(100- setup) 

5 Equation 21 : V iw = V •(100- setup) 

where setup and 100 define the values black and white, respectively, of a composite 
signal. 

Combining equations 16 through 21 results in the following equations 22, 23, 
10 and 24 to convert directly from Y C B C R to YUV iRE . Equation 22, 23 and 24 are defined 
as follows: 

Equation 22 : Y ire = — j^r •(100- setup) • (Y 6m - 1 6) + setup 

219 

Equation 23 : JJ ire = 0 436 ^ 346 # (jqo - setup) • (Qn - 128) 

15 

Equation 24 : Vim = 0 6 14 ^ 383 .(W0- setup) • (Cr - 128) 

Using Equation 22, the formula to convert from Yi RE back to Y6oi is derived, which is 
used for converting luma threshold values from IRE units to 601 units as described 
20 above with reference to Fig. 3. The equation for converting for Yi RE back to Y 6 oi is 
defined in equation 25 below: 

^ 219 (Yire " setup) 

Equation 25 : Y 6 oi = — + 1 6 

(100 -setup) 

For three-component color formats such as the 601 format, where one component 
25 is a luma component and the two other components are chroma components, the 3D 
representation of the valid color region looks like a double cone centered on the luma 
axis as illustrated in FIG. 17A for the 601 format. It should be noted that because the 
601 format has an offset of 128 for both the C B and the C R component, the double cone 
270 is offset from the luma axis Y 6 oi • FIG. 1 7B illustrates a view looking down the axis 
30 of the double cone from point A of FIG. 17A. FIG. 17B illustrates that the cross-section 
272 of the valid color region for Y C B C R has an elliptical shape. 
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FIG. 18A illustrates the valid color region 274 in YUVire color space. Applying 
Equations 22, 23 and 24 to the double-cone valid color region 270 of FIG. 17A produces 
the double cone 274 of FIG. 18A centered around the Y] RE axis. 

FIG. 1 8B is a view of the double cone looking down the Yire axis and shows that 
5 after applying Equations 22, 23 and 24, the cross-section of the double cone 276 of the 
YUVire color space is a circle. Because the three components of the YC b Cr color space 
have been normalized by Equations 22, 23, 24 into the YUVire color space, a unit 
excursion in any dimension of the YUVire color space of FIG. 18A is of equal 
significance. The slope of the cone edges is exactly 45°. Thus, the application of 
10 equations 22-24 to the 601 format to produce components in the YUVire format 
implements the first general step of the transformation. The significance of the 
symmetrical properties of the double cone of YUVire space is described in more detail 
below. 

First, since the double cone 274 is circular, the magnitude of the combined 
15 chroma components, Uire and Vire, can be calculated, and the 3D cone can be collapsed 
into a 2D triangle. 

FIG. 19 illustrates the collapsing color space. This collapse or conversion is 
achieved by converting the Ui RE and Vi RE components into a Ci RE component defined by 

20 ClRE = VUrRE + V?R E? 

In FIG. 19, lines 282 and 284 represent the safe color limits in the two-dimensional 
YCire space. 

In order implement the third general step of the transformation so that the 
25 equations for safe color modification are simpler, the next step is to shift the double 

triangle 280 downward along the Yire axis so that it is centered about the Ci RE axis, and 
scaling the safe color limit 282 to a predetermined threshold value in safe color space. 
Figure 20 illustrates the safe color double-triangle 281 in safe color space. In an 
embodiment of safe color modification, the number 128 is used as the predetermined 
30 threshold value. The number 128 is used because it is a convenient number for 

performing mathematical operations. 8 bits, e.g., 7 magnitude bits and a sign bit, can be 
used to represent values ranging from -128 to 128, which is the same number of bits used 
to represent a color component in 601 format. In a hardware implementation of safe 
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color modification, this symmetry between the number of bits leads to simpler and 
consequently faster circuitry. 

The shifting and scaling involves converting coordinates of the YQre two- 
dimensional coordinate space into the Y Css safe color space. In order to make this 
5 conversion from Y Qre color space to safe color space, the three original components of 
the color component signal, Y6oi, Cb, and Cr, are scaled by an additional factor. An 
offset also is applied to the original luma component Y 6 oi- Equations 26, 27 and 28 
define the conversion from the 601 components to safe color component space: 

1 0 Equation 26 : Yss = Y mu • scaler + offset 

Known values of points 900, 902, 904, 900', 902% and 904' from FIG. 19 are 
applied to provide 

Equation 2 7 : Uss = U ire • scaler 



15 



25 



Equation 28 : Vss = Vire • scaler 

In FIG. 20, the following equations 29, 30 and 31 defining scaley, offset, and scalec are 
obtained: 

256 



20 Equation 29 : scaler = 



Equation 30 : offset = J 28 - Color High 
Equation 31 : scaler = 



Color High - Color Low 

256 



Color High - Color Low 

256 



Color _High - Color Low 

Substituting equations 29, 30 and 3 1 back into Equations 26 through 28, the 
following equations for converting the components of a Y CbCr signal into safe color 
space are defined: 

Equation 32: 

30 256 _( 100 -setup) + 256 (235 setup -1600-109.5 = (Color Jiigh - Color _Low)) 

Yss 2]9 ^ (Color High _ Color _Low) ~ 601 219 _ (Color High - Color _Low) 

. „ 16 • 0.436010346 '(WO- setup) , 

Equation 33 : U S S = z — : ■ n : -—^-•(C B -^S) 

7 • (Color _High - Color Low) 
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J? *s rr 16 * 0.614975383 • (100 -setup) / 

Equation 34: Vss = ——— { ^ZL. (C 12 8) 

7 • (Color High - Color _Low) 

From Equations 32, 33 and 34, Equations 2 - 6 are derived. 

FIG. 21 is a graph illustrating the next step of the conversion process of taking 
5 the magnitude of the safe space luma component Y S s ? and using the limit line 286 that 
defines the line the magnitude of Y + C = 128 to determine whether a color is safe. If the 
sum of the magnitude of luma of a pixel in safe space, Yss, and the chroma of the pixel 
in safe space, Css is greater than 128, then the color of the pixel is not safe. If the sum of 
the magnitude of Y S s, 1 Y S sl, and Css is less than or equal to 128, then the color of the 
10 pixel is safe. 

Referring to FIG. 21, if a pixel is outside the safe area 294, the luma and chroma 
are adjusted to bring the pixel to the safe limit 286. Simply reducing either the luma or 
the chroma individually may generates visually undesirable results. Better results can be 
obtained by changing both luma and chroma equally, providing the closest safe color to 

15 the original color of a pixel. Thus, the adjustment is performed by mapping the color of 
the unsafe pixel to the limiting line 286 in a direction perpendicular to the limiting line 
286. This is illustrated in FIG. 21 for point D which represents the color of a pixel in 
safe color space. In order to correct the color of the pixel, the luma and chroma 
components of the pixel are adjusted along the line 296. 

20 It is possible that the Css value of a pixel may be greater than 128, but Y S s of the 

pixel is less than 128 so long as the luma high threshold value is less than or equal to the 
color high threshold value and the luma low threshold value is greater than or equal to 
the color low threshold value. These conditions are satisfied because the original Ygoi 
value has been clipped as described above with reference to FIGS. 2 and 4, before 

25 entering the safe color limiter. 

Points A and B in FIG. 21 illustrate two situations where the Css component of 
the color of a pixel in safe space is greater than 128. With regard to point A, the same 
method of color modification discussed above with respect to point D may be applied to 
reduce the luma and chroma of the pixel by the same amount, thus mapping the point A 

30 down to point C 2 on the limit line 286 along the line 298. 

However, if point B is mapped to the nearest point on the limit line 286, the 
resulting point is C4, which is still an invalid color. 
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One solution to the problem posed by point B is to map all points that have a Css 
component greater than 128 back to the line 290, which defines C S s =128, and then from 
line 290 perpendicularly to the nearest point on limit line 286. However, both points A 
and B are mapped to the same point CI. This mapping results in A and B having the 
5 same chroma value, although original point B had a greater chroma value than point B. 

Alternatively, any points, such as B, that are to the right of line 288, having a 
chroma greater than the sum of the luma value and the threshold value may be mapped 
along path 312 and 310, and map points on the left of line 288 perpendicularly to the 
limit line 286. However, after this mapping, the chroma of point B is less than the 

10 chroma of point A, and the luma of point B is higher than point A. 

Alternatively, the line 288 which defines C S s =l Y ss|+128 may be used. For 
points to the left of this dashed line, Css<Yss +128 and for points to the right of this 
dashed line, Css^Yssl+128. For example, point A is to the left of the line 288 and point 
B is to the right of the line 288. Using this mapping corrects all points to the left of line 

15 288 in the manner described with respect to point D, by mapping the point 

perpendicularly to the line 286. In contrast, for points to the right of the line 288, using 
point B as an example, safe color limiting maps each point to the line 288, and then 
perpendicularly along the line 288 to the point C3. Point C3 represents a color in safe 
color space |Y S s| = 0 and C S s = 128. The chroma clipper 62 of FIG. 6 implements this 

20 type of chroma clipping as described in FIG. 18, steps 160 -166. The value of the 
converted chroma value 70 can be described by the following equation 35: 

|Yssi + 128 if Css >| Yssl + 128 

Equation 35: C ch = { 

Css if Css^|Y ss | + 128 

25 where C C h is converted chroma value 70, Y S s is the converted luma value 68, and C S s 
equals the combined chroma value 72. 

The point D in FIG. 21 is defined by coordinates (|Y S s|, Cch) and the new value 
to which pixels are limited is defined by the coordinates (Y P , C P ). The results of 
changing just one of the components individually can be seen at points (|Y S s| 9 Q) and 

30 (Yj, Cch). Because the slope of the limit line 286 is -1, Q = 128 «Y S s«. Consequently, 
Z = Cch - Q = Cch - 128 + |Y ssU where Z is the modification that is applied to a color to 
map it to closest safe color. The luma intercepts the limit line 286 at Y P , where: 



WO 00/64189 



PCT/USOO/10082 



10 



-27- 

Equation36 : Yf =1 Yss i -§ - (l YssI + ^ 28 ' Cch) , 

Solving for C,,: 

Equations?: p-Cc.-*- H ^'^^^ 

After Yp has been calculated, the correction factor Yc to be applied to the original Y$oi 
data to generate a safe luma component can be determined. This correction factor is 
scaled by the inverse of the scale factor that was originally applied to the Y«n data. 
Accordingly, Y c can be defined by the following equation 38: 

Equation 38 : Yc m {\Yss\-Yt)* y~ 



Equation 12 can be derived by combining Equations 36 and 38. The Y c of Equation 38 
is the luma correction value 88 of FIG. 6. As described above with reference to FIG. 6, 
the luma correction value 88 is then added to the checked luma component 1 8 to 
generate the safe luma component 26. 

if By adding the luma correction offset 88, as opposed to applying a scalar, to the 

checked luma component 18, round-off errors are minimized and pass-through, where no 
modifications are made is simplified by simply adding 0 to the checked luma component 
L8. Because the modification performed on the luma components is additive, the sign of 
the correction is pertinent, as described above with reference to FIG. 11, steps 176 - 180. 

20 Unlike the checked luma component 1 S which is modified with a luma offset 

value, the first chroma component 10 and the second chroma component 12 are modified 
using scale factors based on Cp . Figure 22 illustrates safe color space expanded into 
three-dimensional space to show the chroma components or vectors Vss» Uss> Vp, and Up 
corresponding to chroma components C s $ and Cp, respectively. FIG. 22 is a view 

25 looking down the Yss axis at the circular chroma cross-section 314 of the safe color cone 
defining the safe color limit. Although the C P vector representing the modified chroma 
component has the same angle as the Css vector, presenting the original chroma 
component, the magnitude of Cp is less than the magnitude of Css. The ratio of C? to Css 
is the same as the ratio of Up and V P to Uss and Vss, respectively. U P and Vp thus can be 

30 defined by the following equations: 

Cp 

Equation 40 : V? = Vss • ±LlL 

Css 
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Equation 39 : Up = Uss • ^ lL - 

Css 

Applying this same ratio to the original chroma components, CR and CB, and accounting 
for the 128 offset for chroma components of the 601 format, the safe chroma components 
may be defined by the following equations: 

5 Equation 41 : Cscrr = [( Cb' 128 )•&-] + 128 

Css 

i 

Equation 42 : Qncorr = [ ( C R - 128 ; • — 7 + 128 

Css 

Equations 41 and 42 can be combined with equations 32-35 and 37 to derive 

10 equations 13-15, which define the chroma correction scalar and how it is applied to the 
original chroma components to produce safe chroma components. 

Safe color modification may be implemented using a computer system. It should 
be understood that safe color modification is not limited by the specific computer 
described herein. Many other different machines may be used to implement the 

15 invention. Such a suitable computer system includes a processing unit which performs a 
variety of functions and a manner well-known in the art in response to instructions 
provided from an application program. The processing unit functions according to a 
program known as the operating system, of which many types are known in the art. The 
steps of an application program are typically provided in random access memory (RAM) 

20 in machine-readable form because programs are typically stored on a non-volatile 

memory, such as a hard disk or floppy disk. When a user selects an application program, 
it is loaded from the hard disk to the RAM, and the processing unit proceeds through the 
sequence of instructions of the application program. 

The computer system also includes a user input/output (I/O) interface. The user 

25 interface typically includes a display apparatus (not shown), such as a cathode-ray-tube 
(CRT) display in an input device (not shown), such as a keyboard or mouse. A variety of 
other known input and output devices may be used, such as speech generation and 
recognition units, audio output devices, etc. 

The computer system also includes a video and audio data I/O subsystem. Such 

30 a subsystem is well-known in the art and the present invention is not limited to the 

specific subsystem described herein. The audio portion of subsystem includes an analog- 
to-digital (A/D) converter (not shown), which receives analog audio information and 
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converts it to digital information. The digital information may be compressed using 
known compression systems, for storage on the hard disk to use at another time. A 
typical video portion of subsystem includes a video image compressor/decompressor 
(not shown) of which many are known in the art. Such compressor/decompressors 
5 convert analog video information into compressed digital information. The compressed 
digital information may be stored on hard disk for use at a later time. An example of 
such a compressor/decompressor is described in U.S. Patent No. 5,355,450. 

One or more output devices may be connected to the computer system. Example 
output devices include a cathode ray tube (CRT) display, liquid crystal displays (LCD) 

10 and other video output devices, printers, communication devices such as a modem, 
storage devices such as disk or tape, and audio output. One or more input devices may 
be connected to the editing or playback system. Example input devices include a 
keyboard, keypad, track ball, mouse, pen and tablet, communication device, and data 
input devices such as audio and video capture devices and sensors. Source and color 

15 modification are not limited to the particular input or output devices used in combination 
with the computer system or to those described herein. 

The computer system may be a general purpose computer system which is 
programmable using a computer programming language, such as "C++," JAVA or other 
language, such as a scripting language or even assembly language. The computer system 

20 may also be specially programmed, special purpose hardware such as an application 
specific integrated circuit (ASIC). In a general purpose computer system, the processor 
is typically a commercially available processor, such as the series x86 and Pentium 
processors, available from Intel, similar devices from AMD and Cyrix, the 680X0 series 
microprocessors available from Motorola, and the PowerPC microprocessor from IBM. 

25 Many other processors are available. Such a microprocessor executes a program called 
an operating system, of which WindowsNT, Windows95 or 98, UNIX, Linux, DOS, 
VMS, MacOS and OS8 are examples, which controls the execution of other computer 
programs and provides scheduling, debugging, input/output control, accounting, 
compilation, storage assignment, data management and memory management, and 

30 communication control and related services. The processor and operating system define 
a computer platform for which application programs in high-level programming 
languages are written. 
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A memory system typically includes a computer readable and writeable 
nonvolatile recording medium, of which a magnetic disk, a flash memory and tape are 
examples. The disk may be removable, known as a floppy disk, or permanent, known as 
a hard drive. A disk has a number of tracks in which signals are stored, typically in 
5 binary form, i.e., a form interpreted as a sequence of one and zeros. Such signals may 
define an application program to be executed by the microprocessor, or information 
stored on the disk to be processed by the application program. Typically, in operation, 
the processor causes data to be read from the nonvolatile recording medium into an 
integrated circuit memory element, which is typically a volatile, random access memory 

10 such as a dynamic random access memory (DRAM) or static memory (SRAM). The 
integrated circuit memory element allows for faster access to the information by the 
processor than does the disk. The processor generally manipulates the data within the 
integrated circuit memory and then copies the data to the disk after processing is 
completed. A variety of mechanisms are known for managing data movement between 

15 the disk and the integrated circuit memory element, and the invention is not limited 
thereto. It should also be understood that the invention is not limited to a particular 
memory system. 

Such a system may be implemented in software or hardware or firmware, or a 
combination of the three. The various elements of the system, either individually or in 

20 combination may be implemented as a computer program product tangibly embodied in 
a machine-readable storage device for execution by a computer processor. Various steps 
of the process may be performed by a computer processor executing a program tangibly 
embodied on a computer-readable medium to perform functions by operating on input 
and generating output. Computer programming languages suitable for implementing 

25 such a system include procedural programming languages, object-oriented programming 
languages, and combinations of the two. 

The computer system used to implement safe color modification is not limited to 
a particular computer platform, particular processor, or particular programming 
language. Additionally, the computer system may be a multi processor computer system 

30 or may include multiple computers connected over a computer network. Each step of 
FIGS. 4, 5, 7-13, and 16 may be separate modules of a computer program, or may be 
separate computer programs. Such modules may be operable on separate computers. 
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Having now described some embodiments, it should be apparent to those skilled 
in the art that the foregoing is merely illustrative and not limiting, having been presented 
by way of example only. Numerous modifications and other embodiments are within the 
scope of one of ordinary skill in the art and are contemplated as falling within the scope 
5 of the invention. 
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CLAIMS 

1 . A method of generating components for a pixel to provide safe color from 
components of the pixel according to a threshold defining safe color, wherein the 
components include a luma component, a first chroma component, and a second chroma 

5 component, the method comprising: 

determining whether a combination of a first luma value associated with the luma 
component and a first chroma value associated with the first and second chroma 
components of the pixel exceeds the threshold defining safe color; and 

if the combination exceeds the threshold defining safe color, modifying the luma 
] 0 component of the pixel so as to generate safe components. 

2. The method of claim 1, further comprising: 

if the combination exceeds the threshold defining safe color, modifying the first 
and second chroma components of the pixel so as to generate components within the 
15 threshold defining safe color. 

3. The method of claim 2, further comprising: 

if the combination exceeds the threshold defining safe color, generating a chroma 
correction scalar value, 

20 wherein the step of modifying the first and second chroma components includes: 

combining the first chroma component and the chroma correction scalar 
value; and 

combining the second chroma component and the chroma correction 
scalar value. 

25 

4. The method of claim 3, wherein if the combination of the first luma value and the 
first chroma value is less than the threshold defining safe color, the chroma correction 
scalar is equal to numerical one. 

30 5. The method of claim 1 , further comprising: 

if the combination exceeds the threshold defining safe color, generating a luma 
correction offset value, 
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wherein the luma component is modified by combining the luma component and 
the luma correction offset value. 

6. The method of claim 5, wherein, the first luma value is a magnitude of a second 
5 luma value, and wherein if the second luma value is a positive value the luma correction 

offset value is a positive value, and if the second luma value has a negative value, the 
luma correction offset value is negative. 

7. The method of claim 5, wherein, if the combination of the first luma value and 
10 the first chroma value is less than the threshold defining safe color, the luma correction 

offset value is numerical zero. 

8. The method of claim 5, further comprising: 

if the combination exceeds the threshold defining safe color, generating a chroma 
15 correction scalar value; and 

modifying the first and second chroma components, including: 

combining the first chroma component and the chroma correction scalar 
value; and 

combining the second chroma component and the chroma correction 
20 scalar value. 

9. The method of claim 1, further comprising: 

receiving safe color parameters defining parameters for the components to be 
generated; 

25 generating luma conversion terms from the safe color parameters; and 

generating the first luma value by applying the luma conversion terms to the luma 
component. 

10. The method of claim 9, wherein the luma conversion terms include a luma scalar 
30 value and a luma offset value. 



1 1 The method of claim 1, further comprising: 
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combining the first luma value and the threshold defining safe color to produce a 
chroma threshold value; and 

generating the first chroma value, including: 

comparing a combination of the first and second chroma components to 
5 the chroma threshold value; and 

if the combined chroma components is greater than the chroma threshold 
value, clipping the combined component value to the chroma threshold value. 



12. The method of claim 1 1 , further comprising: 

10 generating chroma conversion terms from the safe color parameters; 

generating a first chroma conversion value and a second chroma conversion value 
by applying the chroma conversion terms to the first and second chroma components, 
respectively; and 

generating a combined chroma value by combining the first and second chroma 
1 5 conversion values, 

wherein the combined chroma value is the combination of the first and second 
chroma components that is compared to the chroma threshold value. 

13. The method of claim 1 , further comprising: 

20 receiving a luma high threshold value that defines a high threshold for the luma 

component; 

receiving a luma low threshold value that defines a low threshold value for the 
luma component; 

generating a checked luma value, including: 
25 comparing the luma component and to the high luma threshold value and 

the low threshold value; and 

if the luma component is greater than the luma high threshold value or 
less than the luma low threshold value, clipping the luma component to the luma 
high or luma low threshold value, respectively; 

30 and 

if the luma threshold value is not greater than the luma high threshold value or 
less than the luma low threshold value, setting the checked luma component equal to the 
luma component, 
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wherein the step of modifying the luma component modifies the checked luma 
component. 

14. The method of claim 1, wherein the step of determining includes: 

5 combining the first chroma value and a magnitude of the first luma value to 

generate the combination. 

15. The method of claim 1 , wherein if the combination of the first luma value and the 
first chroma value of the pixel exceeds the threshold defining safe color, the method 

10 further comprises: 

generating an interrupt to warn a system user that an unsafe color has been 
detected. 

16. The method of claim 1 , wherein if the combination of the first luma value and the 
15 first chroma value of the pixel exceeds the threshold defining safe color, the method 

further comprises: 

generating an event indicating that an unsafe color has been detected. 

17. A method of generating corrections for modifying components of a pixel to 
20 produce a safe color, according to a threshold defining safe color, the method 

comprising: 

transforming the color components into safe space; 

determining whether a combination of transformed color components exceeds the 
threshold defining safe color; and 
25 if the combination exceeds the threshold defining safe color, generating 

component correction values to be applied to the components and produce safe 
components. 

18. A method of transforming a component color into safe color space, comprising: 
30 receiving a component color of a first color space; and 

transforming the component color into safe space by applying by applying 
conversion terms to each component of the component color, 
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wherein the transformation into safe color space creates symmetrical 
relationships between the color components, the symmetrical relationships permitting 
simplified operations to be performed on the components. 
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